SEQUENCES OF LABELED TREES RELATED TO GELFAND-TSETLIN PATTERNS 



ILSE FISCHER 



Abstract. By rewriting the famous hook-content formula it easily follows that there are Yl ~^ — 

l<i<j <n 

semistandard tableaux of shape (fc„, . . . , fci) with entries in {1, 2, . . . , n} or, equivalently, Gelfand-Tsetlin 

patterns with bottom row {ki , . . . , k„) . In this article we introduce certain sequences of labeled trees, the signed 
enumeration of which is also given by this formula. In these trees, vertices as well as edges are labeled, the crucial 
condition being that each edge label lies between the vertex labels of the two endpoints of the edge. This notion 
enables us to give combinatorial explanations of the shifted antisymmetry of the formula and its polynomiality. 
Furthermore, we propose to develop an analog approach of combinatorial reasoning for monotone triangles and 
explain how this may lead to a combinatorial understanding of the alternating sign matrix theorem. 



1. Introduction 

One possibility to see that the expression 

n (1.1) 

i — i 

l<i<j<n 

is an integer for any choice of (fci,...,fc„) e Z" is to find combinatorial objects that are enumerated by 
this quantity. This is, for instance, accomplished by Gelfand-Tsetlin patterns with prescribed bottom row 
ki, k2, ■ ■ ■ , kn- A Gelfand-Tsetlin pattern (see [TTl p. 313] or [7, (3)] for the first appearance) is a triangular 
array of integers with n rows of the following shape 

ai,i 

02,1 02,2 



an-1,1 an-1,2 • ■ • ■ ■ • a-n-Ln-l 

^n,l ^n,2 ^n,3 ■ • ■ ■ • • ^n^n 

that is monotone increasing along northeast diagonals and southeast diagonals, i.e. Uij < ai^ij for 1 < j < 
i < n and aij < Oi+i^+i for 1 < j < i < n. It is conceivable to assume that (fci, . . . , k„) e Z"q, as Gelfand- 
Tsetlin patterns with bottom row (fci, . . . , fc„) are obviously in bijective correspondence with Gelfand-Tsetlin 
patterns with bottom row (fci + t, . . . ,kn + t) for any integer i G Z. Under this assumption, they are equivalent 
to semistandard tableaux of shape (A;„, . . . , fci) with entries in {1,2, ... ,n}, the latter being fillings of 
the Ferrers diagram associated with the integer partition (fc„, fc„_i, . . . , fci) that are weakly increasing along 
rows and strictly increasing along columnsQ Next we give an example of a Gelfand-Tsetlin pattern and the 
corresponding semistandard tableaux. 

2 

2 2 1 1 3 3 5 6 

1 2 4 2 2 4 6 6 

1 1 3 4 3 5 5 

1 3 3 5 4 6 
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"'^Note that there is actually no dependency between the number of feasible values for the entries of the semistandard tableaux 
and the number of parts in the integer partition: semistandard tableaux of shape {km, fcm-ii • ■ ■ , ^i) with entries in {1, 2, . . . , n} 
are equivalent to semistandard tableaux of shape {km, km—i, . ■ ■ , fci , O"""*) with entries in {1, 2, . . . , n} if n > m and there exists 
no semistandard tableau otherwise. 
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In general, given a Gelfand-Tsetlin pattern {aij)i<j<i<n, the corresponding semistandard tableau is constructed 
by placing the integer i in the cells of the skew shape 

i)/(ai-i,i-i,ai-i,i-2, ■ • . ,aj_i,i). 

Semistandard tablearrx of fixed shape (and thus Gelfand-Tsetlin patterns) are known to be enumerated by the 
hook-content formula Corollary 7.21.4], which is easily seen to be equivalent to (|l.ip . see also [11] Lemma 
7.21.1]. A common way to prove this formula is to translate the problem into the enumeration of families of 
non-intersecting lattice paths with a certain set of fixed starting points and end points. To complement the 
treatment given in this article, we sketch this point of view in Appendix El A direct proof of the fact that 
Gelfand-Tsetlin patterns with bottom row fci, fc2, . . . , fc„ are enumerated by (jl.ip can be found in [2j Section 5]. 
There we have actually proven a more general result, which we describe in the following paragraph. 

The reader will have noticed that the combinatorial interpretations that we have given so far only provide an 
explanation for the integrality of (jl.ll) if the sequence fci, fc2, . . . , fc„ is weakly increasing. This can be overcom^l 
by extending the combinatorial interpretation of Gelfand-Tsetlin patterns with bottom row (fci, . . . , fc„) to all 
n-tuples of integers (A:i,...,fc„) and working with a signed enumeration as follows: a (generalized) Gelfand- 
Tsetlin pattern is an array of integers (aij)i<j<i<n such that the following condition is fulfilled: for any Uij 
with l<j<i<ri— Iwe have a^+ij < aij < ai+i^+i if ai+ij < Oi+ij+i and ai+ij > aij > ai+i j+i if 
Oi+ij > fli+i j+i. (In particular, there exists no generalized Gelfand-Tsetlin pattern with fli+ij = Oi+ij+i + 1.) 
In the latter case we say that Uij is an inversion. The weight (or sign) of a given Gelfand-Tsetlin pattern is 
(— 1)'^ of inversions ^j^j^ |-]^jg^ (|l.ip is the sigucd enumeration of all Gelfand-Tsetlin patterns with bottom row 

fci , fc2 , . . . , kn . 

The main task of the present paper is to provide a whole family of sets of objects that come along with 
a rather canonical notion of a sign, the signed enumeration of each of these sets is given by (jl.ip . We call 
these objects Gelfand-Tsetlin tree sequences as Gelfand-Tsetlin patterns are one special member of this family. 
The definition of these objects is given in Section [51 This enables us to give a combinatorial proof of the fact 
that Gelfand-Tsetlin patterns are enumerated by (jl.ip . Interestingly, this combinatorial proof is not based 
on a bijection between Gelfand-Tsetlin patterns and a second type of objects which are more easily seen to 
be enumerated by (|l.ip . Rather than that we give combinatorial proofs of the facts that the replacement 
{ki,kj) — (fcj + j — i, hi — i + j) in the enumeration formula for the number of Gelfand-Tsetlin patterns 
with prescribed bottom row only causes the inversion of the sign (Section [3]) as well as that the enumeration 
formula must be a polynomial in (fci, . . . , fc„) of degree no greater than n — 1 in every ki (Section For 
each of these properties, this is accomplished by providing an appropriate member of the family for which the 
respective property is almost obvious. Then, it is not hard to see that these properties essentially determine the 
enumeration formula, which is the only algebraic part of the proof. Note that the first property can obviously 
only be understood combinatorially after having extended the combinatorial interpretation of Gelfand-Tsetlin 
patterns with bottom row ki,k2, . . . ,kn to arbitrary (fci, k2, . . . , fc„) £ Z" as the sequence fci, . . . , ki-i, kj + j — 
i, fci+i, . . . , kj-i, ki -\- i — j, /cj+i, . . . ,kn can not be weakly increasing if fci, ^2, ■ • • , is weakly increasing. Also 
the inversion of the sign surely indicates that a signed enumeration must be involved. 

However, the original motivation for this paper is the intention to translate some of the research we have done 
on monotone triangles into a more combinatorial reasoning. Monotone triangles are Gelfand-Tsetlin patterns 
with strictly increasing rows and their significance is due to the fact that they are in bijective correspondence 
with alternating sign matrices when prescribing 1,2, ... ,n as bottom row. It took a lot of effort to enumerate 
n X n alternating sign matrices and all proofs known so far can not be considered as combinatorial proofs as 
they usually involve heavy algebraic manipulations, see T. Also the long-standing "Gog-Magog conjecture" [9], 
which is a generalization of the fact that n x n alternating sign matrices are in bijective correspondence with 
2nx2nx 2n totally symmetric self-complementary plane partitions is still unsolved, which is another indication 



"Of course, this also follows by choosing a permutation a £ Sn with k^i + o"l < kcr2 4- o"2 < ... < kcr„ + ""n and then 

k fj- . ^CT ^ ^ J ^ i ]£ ■ ]£ - 'j Z 

observing that [I — ~i = sgncr [l ~ — ^rj number of Gelfand-Tsetlin patterns with bottom row 

l<i<j<n l<i<j<n 
(fco-i + O"! — 1, feo-j + (72 — 2, ... , ka„ + CFn — n) . 
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for the fact that ahernating sign matrices (as well as plane partitions) are combinatorial objects that are rather 
persistant against combinatorial reasonings. 

Our own proof of the alternating sign matrix theorem [41 makes us believe that it could be helpful to work with 
signed enumerations: let a(n; fci, . . . , fc„) denote the number of monotone triangles with bottom row fci, . . . , fc„. 
The key identity in this proof is the following. 

a(n; fci, . . . , fc„) = fc2, . . . , fc„, h - n) (1.2) 

Obviously, this identity does not make any sense at first as fc2, fcs, . . . fc„, /ci — n is not strictly increasing if 
ki,k2, ■ ■ ■ ,kn is strictly increasing. However, it is not hard to see that, for fixed n, the quantity a(n; fci, . . . , fc„) 
can in fact be represented by a (unique) polynomial in fci , . . . , fc„ and so (jl.2l) can be understood as an identity 
for this polynomial. On the other hand, it is also possible to give a{n; ki, . . . , kn) a combinatorial interpretation 
for all (fci,...,fc„) G Z" in terms of a signed enumeration. We have provided such an interpretation in [5] 
and give three additional but related extensions in the concluding section of this article. These extensions 
provide combinatorial interpretations of (jl.2p and to give also a combinatorial proof of this identity could be 
an important step towards a combinatorial understanding of the alternating sign matrix theorem as we explain 
in Section [S] It is hoped that a combinatorial proof of this identity as well as of other interesting identities 
involving monotone triangles follows the same lines as the combinatorial reasonings we present in this article 
for Gelfand-Tsetlin patterns. 

2. Definition of Gelfand-Tsetlin tree sequences 

In this paper, an n— tree is a directed tree with n vertices such that the vertices are identified with integers 
in {1, 2, . . . , n} and the edges are identified with primed integers in {1', 2', . • ■ , {n — 1)'}. In Figure [1] we give 
an example of an 8-tree. We consider sequences of trees: a tree sequence of order n is a sequence of trees 
T — (Ti,r2, . . . ,r„) such that Ti is an i-tree for each z, see Figure 2] for an example of order 5. Each member 
of the family, the signed enumeration of which is given by (jl.l|) , will have a fixed underlying tree sequence of 
order n. The actual objects will be certain admissible labelings (vertices and edges are labeled; the labels must 
not be confused with the "names" of the vertices and edges) of the underlying tree sequence. Gelfand-Tsetlin 
patterns will be one member of this family; in the underlying tree sequence B = (Si, i?2, • ■ • , S„), the i-trees 
Bi are paths with the canonial labeling, i.e. j' — + 1) € E{Bi) for j = 1, 2, . . . , i — 1. In the following, the 
tree Bi will be referred to as the basic i-tree. In Figure [31 we display the respective tree sequence of order 6 
(left figure) and the admissible labeling (a notion to be defined below) that corresponds to the Gelfand-Tsetlin 
pattern given in the introduction (right figure). In the right figure, we suppress the "names" of the vertices and 
edges in order to avoid a confusion with the labelings. However, these "names" are just the second summands 
of the labelings, whereas the first summand corresponds to the respective entry of the Gelfand-Tsetlin pattern 
given in the introduction. 

We work towards defining admissible labelings of tree sequences. 

Definition 1. Let T he an n-tree and k = (fci, . . . , fc„) G Z". A vector 1 = {li, . . . , In-i) G Z"^^ is said to be 
admissible for the pair (T, k) if for each edge j' — {p, q) of T the following is fulfilled: if kp + p < kq + q then 
kp + p < Ij + j < kq + q and otherwise kq + q < Ij + j < kp + p. In the latter case we say that the edge j' is an 
inversion of the pair (T, k) . 

Phrased differently, if we label vertex i with ki + i and edge j' with Ij -\- j for all i and j then, for each edge, 
the edge label is greater or equal than the minimum of the two vertex labels on the endpoints of the edge but 
smaller than the maximum. The edge is an inversion if it is directed from the maximum vertex label to the 
minimum vertex label. If, for an edge, the label of the tail coincides with the label of the head then there exists 
no vector 1 that is admissible for the pair (T, k). In the following, we address the vectors k -f (1, 2, . . . , n) and 
l+(l,2,...,n — 1) as the vertex labeling, respectively edge labeling of the tree and the vectors k and 1 as the 
shifted labelings. 

For instance, consider the 8-tree T in Figure [T] and the vector k — (4, 1, 7, 2, 4, 2, 6, 1) G Z^. Then the vector 
1 = (6, 3, 9, 5, 1, 2, 1) is admissible for (T, k), see Figure |31 The inversions are 2', 3', 6'. Also observe that there 
is no admissible shifted labeling 1 if k = (4, 1, 7, 2, 4, 2, 6, 2) as there is no I4 with 2 + 8</4 + 4<7 + 3. 
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Figure 1. An 8-tree. 
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Figure 2. A tree sequence of order 5. 
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Figure 3. Tree sequence for Gelfand-Tsetlin patterns of order 6 and an example of an admis- 
sible labeling. 



Now we are in the position to define Gelfand-Tsetlin tree sequence. 

Definition 2. A Gelfand-Tsetlin tree sequence associated with a tree sequence T — (Ti, . . . , T„) of order n and 
a shifted labeling h G Z,"' of the vertices ofTn is a sequence (li, I2, • . • , In) of vectors li S with In = k such that 
li_i is admissible for the pair (Ti, li) if i — 2,3, ... , n. We let k) denote the set of these Gelfand-Tsetlin 

tree sequences. 



In Figure [5l we give an example of a Gelfand-Tsetlin tree sequence associated with the tree sequence displayed 
in Figure [5] Observe that k = (5,6,3,-3,0) in this case. An edge label is displayed in italic type if the 
corresponding edge is an inversion. In Figure [31 we represent the Gelfand-Tsetlin pattern from Section [T] as a 
Gelfand-Tsetlin tree sequence associated with {Bi,B2, i?3, B4, B^^Bq). 
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Figure 4. An example of an admissible labeling. 
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Figure 5. A Gelfand-Tsetlin tree sequence. 



We give a preliminary definition of the sign of a Gelfand-Tsetlin tree sequence: the inversions of a Gelfand- 
Tsetlin tree sequence are the inversions of the pairs (Ti,li) for i = 2,3,...,n and the sign is defined as 
of mvorsions^ The (preliminary) sign of the Gelfand-Tsetlin tree sequence given in Figure [S] is —1 as 
there are 7 inversions. We will see that the signed enumeration of Gelfand-Tsetlin tree sequences associated 
with a fixed tree sequence T = (Ti, . . . , r„) of order n and a fixed shifted labeling k = (fci, . . . , fc„) of the 
vertices of T„ is, up to a sign, equal to (jl.ip . This sign only depends on the underlying unlabeled tree sequence 
T and will be defined next. After that we adjust the definition of the sign of a Gelfand-Tstelin tree sequence 
by multiplying this global sign. 

For this purpose, we define the sign of an n— tree T: fix a root vertex r of the tree. The standard orientation 
with respect to this root is the orientation in which each edge is oriented away from the root. An edge in T is 
said to be a reversed edge if its orientation does not coincide with the standard orientation. If, in our example in 
Figurejl] we choose 2 to be the root then the reversed edges are 3', 4' and 7'. Except for the root, each vertex is 
the head of a unique edge with respect to the standard orientation. We obtain a permutation tt of {1, 2, . . . , n}, 
if we order the head vertices of the edges in accordance with their edge names (i.e. for the edges i' = (a, b) and 
j' — {c,d) with i < j, the vertex b comes before vertex d in the permutation) and prepend the root r at the 
beginning of the permutation. In our running example, we obtain the permutation tt = 2317854 6. Then the 
sign of T is defined as follows. 



sgnr = (-l) 



9^ of reversed edges 



SgnTT 



(2.1) 



The sign of the tree in Figured] is 1 as there are 3 reversed edges and sguTr = — 1. 

We need to show that the sign does not depend on the choice of the root: suppose s is a vertex adjacent to 
the root r. If we change from root r to root s, we have to interchange r and s in the permutation tt, which 
reverses the sign of tt. This is because the standard orientation with respect to the root s coincides with the 
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standard orientation with respect to the root r except for the edge incident with r and s, where the orientation 
is reversed. For the same reason, shifting the root from r to s, either increases or decreases the number of 
reversed edges by 1. Consequently, the product in (j2.1l) remains unaffected. 

The sign of a tree sequence T = {Ti,T2, . . . ,r„) is defined as the product of the signs of the z-trees in 
the sequence, i.e. 

sgn7"= sgnTi • sgnT2 • ■ - sgnTn. 

The sign of the tree sequence in Figure[2]is —1 as sgnTi — 1, sgnr2 — 1, sgnTa — —1, sgnT4 = 1, and sgnTs = 1. 
Concerning Gelfand-Tsethn patterns we obviously have sgn Bi = 1 , which implies sgn B = I. 

Here is the final definition of the sign of a Gelfand-Tsetlin tree sequence L = (li, I2, . . . , In) € ^n{T, k): 

sgn L = (-!)# i"™--^!™^ °f ^ • sgnT 

The signed enumeration of elements in k) is denote by L„(T, k). The sign of the Gelfand-Tsetlin tree 

sequence given in Figure [5] is 1 as there are 7 inversions and the sign of the underlying unlabeled tree sequence 
is —1. We are in the position to state an important result of this paper. 

Theorem 1. The signed enumeration of Gelfand-Tsetlin tree sequences associated with a fixed underlying 
unlabeled tree sequence T = (Ii, . . . , T„) of order n and a shifted labeling k = (fci, . . . , kn) of the vertices of Tn 
is given by 

TT kj — ki -\- j i 

j — i 

l<i<j<n •' 

Before we turn our attention to searching for properties of L„ (T, k) that determine this quantity uniquely, 
we want to mention an obvious generalization of Gelfand-Tsetlin tree sequences, which we do not consider in 
this article, but might be interesting to look at: the notion of admissibility makes perfect sense if the tree T is 
replaced by any other graph. Are there any nice assertions to be made on "Gelfand-Tsetlin graph sequences"? 

3. Properties of L„(7', k): independency and shift-antisymmetry 

We say that a function /(/ci, . . . , fc„) on Z" is shift-antisymmetric iff 

/(/ci, . . . , fc„) = -/(fci, . . . , h^i,kj + j - i, ki+i, . . . , kj^i,k, + i~ j, /cj+i, . . . , fc„) 

for all i,j with 1 < i < j < n and all (/ci, . . . , G Z". In this section we prove by induction with respect to n 
that the signed enumeration L„(7~, k) has the following two properties. 

• Independency: L„(T, k) does not depend on the tree sequence T- 

• Shift-antisymmetry: L„(T, k) is shift-antisymmetric in k = (fci, . . . , fc„). In fact, we prove the 
following stronger result: fix i,j with 1 < i < j < n. We construct a tree sequence of order n, denoted 
by S^^ , and an associated sign reversing involution on the set of Gelfand-Tsetlin tree sequences of the 
tree sequence iS^'-' such that the shifted vertex labeling k e Z" of the largest tree is transformed into 

Ei:''El~^ Sk^^k.'i^ = (fci, • • . fcj + j - i, fci+i, . . . ,fcj_i,/ci + i~ j, fcj+i, . . . ,fc„), 

where Sx,yf{x, y) = f{y, x) and Exp{x) = p{x + 1). 

The proofs are combinatorially in the following sense: suppose we are given two sets A and B and a signed 
enumeration |.|_ on each of the sets such that = \B\-. Then we find decompositions of A and B into 

two sets Ai,A2 and Bi,B2, respectively, such that there is a sign preserving bijection between Ai and Bi and 
1^2!- = 1^2!- — 0, where the latter identities are proven by giving sign reversing involutions on A2 and B2- 
However, if we have = — |_B|_ then the bijection between Ai and Bi is sign reversing. 

Observe that there is nothing to prove for n = \. We deal with the independency first. 

Lemma 1. The independency and shift- antisymmetry for order n — 1 implies the independency for order n. 
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Figure 6. The 8-tree is obtained from the 8-tree in Figure [T] by shding edge 5' along edge 7'. 

Proof. For a tree sequence T = (Ti, T2, . . . , r„) of order n we have 

L„(r,k)=sgnT„.(-l)#°f"°-°f(^"''') J2 L„-i(r<„,l), 

1 G Z""^ is admissible for (T„,k) 

where 7<„ = (Ti, T2, . . . , T„_i). The independency for n — 1 imphes that i„(7", k) is invariant under the 
replacement of 7<n by any other tree sequence of order n — 1. We have to show that it is also invariant under 
the replacement of T„ by any other n-tree. The strategy is as follows: we first show that L„{T,]i) is invariant 
under certain tree operations on T„ and then verify that every tree can be obtained from every other by means 
of these operations. To prove this invariance, we often replace 7<n by a particularly convenient tree sequence. 

We define the first tree operation: let T„ be an n-tree and be an n-tree which is obtained from T„ by 
reversing the orientation of a single edge. Then sgnr„ = — sgnT^, the number of inversions of (T„,k) differs 
from the number of inversions of (T^, k) by 1 and 1 £ Z"^^ is admissible for (T„, k) if and only if 1 is admissible 
for (T^,k). This implies that L„(T, k) is invariant under the replacement of T!„ by T^. 

For the second operation we assume n > 3. It is illustrated in Figure [6] and defined as follows: suppose that 
i' and j' are two edges in the n-tree T„ that have a vertex q in common. Let be the tree we obtain from 
Tn by replacing vertex q in i' by the vertex of j' which is different from q. Then we say that is obtained 
from Tn by sliding edge i' along edge j' . In the following argument, we let p be the vertex of i' in T„ that 
is different from q and r be the vertex of j' that is different from q. 

We show sgnT„ = sgnT^: let q be the root. The head of the old edge i' (i.e. in T„) as well as of the new 
edge i' (i.e. in T^) is p with respect to the standard orientation. Moreover, the edge i' is reversed in T„ if and 
only if it is reversed in T^. There is no change for the remaining edges, since the standard orientation does not 
change there. Hence, neither the permutation tt nor the set of reversed edges is changed. 

In order to show that L„(7~, k) is invariant under the replacement of T„ by T^, we have to distinguish between 
the six possibilities for the relative positions of kp + p,kq + q, kr + r. As we have a symmetry between vertex q 
and vertex r we may assume without loss of generality that kg + q < kr + r. We let T' denote the tree sequence 
that we obtain from T by replacing T„ by T^. 

Case 1. kp + p < kg + q < kr + r: we decompose £„(T'',k) into two sets as follows. Let 1 £ Z"^^ be an 
admissible shifted edge labeling of T^. The first set contains the Gelfand-Tsetlin tree sequences where the label 
of edge i' fulfills kp + p < li + i < kg + q, whereas for the second set we have kg + q < li + i < kr + r. The 
signed enumeration of the first set is obviously equal to £„(?", k), since the edge i' is an inversion of T„ if and 
only if it is an inversion of T^. We have to show that the signed enumeration of the second set reduces to zero: 
we replace 7<n by As kg + q < U + i < kr + r and kg + q < Ij + j < kr + r, the sign reversing involution 
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on the set of all Gelfand-Tsetlin tree sequence associated with induces a sign reversing involution on the 

second subset of £„(T',k). 

Case 2. kg + q < kp + p < kr + r: if 1 G Z"^^ is an admissible shifted edge labeling of T„ for an element of 
£„(T, k) then we have kg + q < li + i < kp + p; in Cn{T' , k) we have kp + p < li + i < kr + r. The edge i' is 
an inversion for the pair (T„, k) if and only it is no inversion for the pair (T^, k). We decompose both sets into 
two sets according to the edge label of j': in the first set we have kg + q < Ij + j < kp + p and in the second 
set we have kp + p < Ij + j < kr + r. If we replace 7<n by we see that in case of £„(?", k) the signed 

enumeration of the first set is zero, while for /3„(T',k) the signed enumeration of the second set is zero. For 
the two other sets, the replacement of {li, Ij) — ^ {Ij + j — i,h + i — j) of the shifted edge labels of the largest 
tree and performing the sign reversing involution on Sl^''_i is a sign preserving involution. 

Case 3. kq + q < kr + r < kp+p: for the edge label of i' in r„ we have kq+q < k+i < kp+p. We decompose 
Cn{T, k) into two sets, where we have kq + q < k + i < kr + r and kr + r < k + i < kp + p, respectively. As 
kq + q < Ij + j < kr + r, the signed enumeration of the first set is zero, while the signed enumeration of the 
second set coincides with the signed enumeration of the elements in k). 

In order to conclude the proof of Lemma [TJ it suffices to show that every n-tree can be transformed into 
every other by means of the two operations "sliding an edge along another edge" and "reversing the orientation 
of an edge" . As both operations are in fact involutions, it suffices to show that every n-tree can be transformed 
into the basic n-tree B„. First of all, it is obvious that sliding and reversing can be used to transform a given 
n-tree into a directed path. Hence, it suffices to show that it is possible to interchange vertices as well as edges. 
In both cases, it suffices to consider adjacent vertices, respectively edges. Concerning edges, suppose x' and y' 
are adjacent edges. By possibly reversing the orientation of one edge, we may assume without loss of generality 
that x' = (a, 6) and y' = {b,c). Then the following sequence of operations interchanges the edges: 

x' = (a, b),y' ^ (6, c) -> x' = (a, c),y' ^ (6, c) x' = (a, c), y' = (6, a) 

X — [b, c), y' — {b, a) ^ x' — {h, c),y' — (a, b) 

(Note that all operations except for the last are slides, which implies that interchanging edges reverses the sign 
of the n-tree.) Concerning swapping vertices, assume that we want to interchange vertex a and b and that 
x' = (a, b) is an edge. We reverse the orientation of x' and slide all edges incident with a but different from x' 
along x' to b as well as all edges incident with b but different from x' along x' to a. (Again we see that swapping 
vertices reverses the sign.) □ 

Now we turn to the shift-antisymmetry. 
Lemma 2. The independency for order n implies the shift- antisymmetry for order n. 

Proof. Fix i,j with 1 < i < j < n. We define a tree sequence iS^'-' — (Ti, . . . ,r„) of order n: let Sm be the 
directed tree with m vertices sketched in Figure [7] and, for 3 < m < n, let this be the underlying tree for Tm- 
(Note that there is no choice for the underlying tree if m — 1,2.) There are no restrictions on the names of the 
vertices and edges except that the two sinks in T„ are i and j, the two sinks in r„_i are the unprimed versions 
of the edges incident with i and j in r„_i, the two sinks in T„_2 are the unprimed versions of the edges incident 
with the two sinks in T„_i etc. Let k = (fci, . . . , fc„) £ Z" and k' = E-'^^ E]^-' Ski,kj^- Then the following is a 
sign reversing involution between the Gelfand-Tsetlin tree sequence associated with Sli^ and fixed shifted vertex 
labeling k of T„ and those where the shifted vertex labeling of T„ is given by k': for m > 3, we interchange in 
Tm the labels of the two sink vertices as well as the labels of the two edges incident with the sinks; in T2 we 
interchange the two vertex labels. This either produces or resolves an inversion in T2 and concludes the proof 
of Lemma [21 

Alternatively, we can also argue as follows: let be the tree which we obtain from T„ by interchanging vertex 
i and vertex j (the underlying tree remains unaffected) and T' = (Ti, . . . , T„_i, T^^). As sgnT„ = — sgnT^, we 
obviously have 

L„(r,k) = --El^'E^^Su^^u,Lr,{J-',\^. 
The assertion follows from Lemma [1] since L„(7~',k) — L„(T, k). □ 
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Figure 7. The tree Sm- 

In Appendix|Bl a direct combinatorial proof of the shift-antisymmetry of the enumeration formula for Gelfand- 
Tsetlin patterns is sketched, which does not make use of the notion of Gelfand-Tsetlin tree sequences. 

4. Taking differences - L„(7', k) is a polynomial 

The quantity k) is not characterized by the properties we have derived so far. Next, we show that 

Ln (T, k) is a polynomial of degree no greater than n — 1 in every ki , which is the last ingredient to finally see 
that it is equal to (jl.ll) . 

In order to show that p{x) is a polynomial in x of degree no greater than n — 1, it suffices to prove that 
A"p(a;) = where A^, := — id is the difference operator. Thus it suffices to show the following. 

Lemma 3. For i G {1, 2, . . . ,n} we have AjJ.L„(7~, k) = . 

Proof. We define a convenient tree sequence TZns = {Ri, ■ ■ ■ ,Rn) (see Figure [5]) and find a combinatorial 
interpretation for A], L„(7?.„.i, k) if j G {0, 1, . . . , n — 1}: in i?„, we require i =: i„ to be a leaf, in i?„-i we 
require the unprimed version i„_i of the edge incident with in in i?„ to be a leaf, in Rn~2 we require the 
unprimed version i„_2 of the edge incident with i„_i in Rn-i to be a leaf etc. As for the orientations of the 
edges i'l, . • . , "in-i, we choose the vertices i2, 13, . . . , i„ to be sinks. By + ii, /^^ + 12, . . . , + in-i, we 
denote the respective edge labels (which are of course also vertex labels in the next level). 

We define A|,.£„(7^„^i, k): it is the set of labeled tree sequences on the unlabeled tree sequence TZn,i such that 
the conditions on the edge labels are as for Gelfand-Tsetlin tree sequence in £„(7^„^i,k), except for the edges 
i'„-.j,i'n-j+i, ■ ■ ■,Ki-i i'aRn-]+i,Rn-]+2, ■ ■ ■ , Rn, respectively, where we require -|-i„_j = +i„-j+i = 

. . . = +*n-i — ki + i. As for the sign, we compute it as usual only we ignore the contributions of the edges 
i'n-j e E{Rn-j+i),i'„_j+i G E{Rn^j+2), ■ ■ ■ ,4-1 e E{Rn). 

Then, by induction with respect to j, the signed enumeration of these labeled tree sequences on TZn,i is equal 
to A^,i„(7?,„_i, k): for j = this is obvious. It suffices to show that 

AfeJA^^/„(7e„,„k)|_ = |Ai.+V„(7^„,„k)|_. 

Consider an element from ii'^. A|,. £„(??.„. i, k) such that the vertex label of the sink in-j of the edge in 
Rn-j (which is . -I- in-j = fc^ 4- i + 1) is greater than the vertex label of the other endpoint of the edge. 
Then, by decreasing the labels + in-j, + in-j+i, • • ■ , ^i„_i + in-i, ki + i + 1 (which are all equal) 

by 1, we obtain a corresponding element in Aj, Cn{TZn,i, k), except for the case when + in-j-i — ki+i. 

In such a tree sequence, we also decrease the labels li„_j + in~j, + *n-j+i, • • • , + *ri-i, ki + i + 1 

by 1 to obtain an element of A-i^^£„(72.„^i, k). This way, we obtain exactly the elements of A^^"'^L„(7?.„_i, k) 
such that the edge i'n_j_i is no inversion in Rn-j. On the other hand, if the edge is an inversion for an 

element of A^XTi(7^ri,i, k), then, by increasing the labels li^_^ +in-j,li„_j_i_-i +in-j+i, . ■ . ,k„^i +in-i,ki + i by 
1, we obtain a corresponding element in _Efc. A^, £„(7?.„^i, k), except for the case when li^_j_-^ +in-j-i = ki+i. 
This way, we obtain exactly the elements of Aj^^ Ln(JZn,i, k) such that the edge i'n_j_i is an inversion in Rn-j. 
The sign that comes from the inversion i',-^_j_i in Rn^n-j takes into account for the fact that we "subtract" the 
greater set from the smaller set in this case. 

Now observe that in fact A5!^^£„(7?,„^i, k) does not depend on ki and, consequently, AJJ. L„(7?.„_i, k) must be 
zero. □ 
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Figure 8. Tree sequence in the proof of LemmaO 



We are finally in the position of prove Theorem [TJ 

Proof of Theorem]^ By the shift-antisymmetry (Lemma [5]), we conclude that the polynomial (Lemma [3]) 
L„(T, k) vanishes if ki + i ~ kj + j for distinct i, j G {1, 2, . . . , n}. This implies that the expression in (jl.ip has 
to be a factor of Ln{T, k). Again by Lemma [3j we know that it is a polynomial of degree no geater than n — 1 
and since (jl.ip is of degree n — 1 in every ki , this implies that 



L„(r,k) = c 



n 

l<z<j<n 



k,+j 



where C G 
that C = 1. 



As there is only one Gelfand-Tsetlin pattern with bottom row (1, 1, . . . , 1) G Z", we can conclude 



The combinatorial interpretation of £„(7^„ i, k) was surely the main ingredient in the proof of Lemma [3] 
The remainder of this section is devoted to use basically the same idea to give a combinatorial proof of the 
identity 

ep(Afc,,...,AfcJi„(r,k) =0, 



(4.1) 



which holds for p > 1 and where 

ep(^i, 



E 

l<ii <i2 < - <ip<n 



■X, 



is the /9-th elementary symmetric function. (An algebraic proof, which already uses the fact that L„(T, k) is 
equal to (|l.ip as well as the presentation of in terms of a determinant (see ([A.!!) ), can be found in [U 

Lemma 1].) This identity is of interest as it is the crucial fact in the proof of (|1.2p given in [3]. 

Even though the ideas are straight forward, this combinatorial proof of (|4.ip is a bit elaborate. (However, 
nothing else is to be expected when a statement is related to alternating sign matrix counting.) In fact, the 
benefit of this exercise is not primarily the proof of (j4.ip but an improvement of the understanding of how to 
interpret the application of difference operators to enumerative quantities such as Ln{T, k) combinatorially. To 
give a hint as to why such an understanding could be of interest, observe that the proof of (j4.ip relies on a 
combinatorial interpretation of 

Afc^^Afe,^ ...Afc,^i„(r,k) (4.2) 
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for subsets {ii, . . . , ip} C [n]. As the number of monotone triangles with bottom row {ki, . . . , fc„) is given by 



where 5x = id—E^ ^ is a second type of difference operator (see Section [SJ, ideas along these lines might also 
lead to a combinatorial proof of this formula. 

We need a more general notion of admissibility. The idea is simple and very roughly as follows: we require 
each vertex of a fixed vertex set R of the tree T to have an associated edge incident with it such that the edge 
label takes on the extreme label given by the vertex label. 

Definition 3. Given an n-tree T, an n-tupel k — (fci, . . . , fc„) G Z" and a subset R C [n] =: {1, 2, . . . , n} of 
vertices of T , we define a vector 1 — {li, . . . ,ln-i) G Z"^^ to be weakly i?,-admissible for the pair (T, k) as 
follows. 

• For each vertex r ^ R of T , there exists a unique edge i{r)' of T incident with r such that + r = 
h(r) + i{r)- 

• For the edges j' — {p,q) that do not appear in the image i{Ry we have min(fcp + p,kq + q) < Ij + j < 
max(fcp + p,kq + q). (Note that for those edges we do not allow Ij + j ~ kp + p or Ij + j = kq + q if 
p £ R or q Cz R, respectively.) 

The vector 1 is said to be i?-admissible if the function i : R ^ [n — 1] is injective. If the function is not 
injective then we choose for each pair of distinct vertices r, s R that share an edge i{ry ~ *(s)' one endpoint 
to be the dominating endpoint. 

An example is given in Figure IHl For the extreme cases concerning R, we have the following; the weak 
0-admissibility coincides with the ordinary admissibility and there exists no [nj-admissible vector as there is no 
injective function i : [n] ^ [n — 1]. If n = 1 then there exists an i?-adniissible vector if and only if i? = 0, 
namely the empty set. 

We introduce the sign which we associate with (T, k), i : R ^ [n — 1] and a choice of dominating vertices 
(if necessary) . The following manner of speaking will turn out to be useful: if we refer to the minimum of an 
edge then we mean the minimum of the two labels of the endpoints of the edge or, by abuse of language, the 
respective vertex where this minimum is attained; similar for the maximum. If, for an edge j' , the labels on the 
two endpoints coincide then the edge must be in the image i{R)' . If i^^{j) contains a unique vertex then we 
define this to be the "maximum" of the edge and if i~^(j) contains both endpoints then the dominating vertex 
is defined as the "maximum" ; in both cases the other endpoint is defined as the minimum. As for the sign, we 
let each vertex that is an inversion contribute a —1 (which is the case when it is directed from its maximum to 
its minimum) as well as each r £ R that is the minimum of the edge i(r)'. 

We define {n, m, i?)-Gelfand-Tsetlin tree sequence as follows. 

Definition 4. Let m < n be positive integers, T = (Ti, . . . ,T„) be a tree sequence, R C [ni] be a set of vertices 
of Tjn and k £ Z" 6e a shifted labeling of the tree Tn. An (n,m, i?)-Gelfand-Tsetlin tree sequence associated 
with T and k is a sequence L — (li, I2, . . . , I^) with U G Z* and 1„ = k which has the following properties. 

• The shifted labeling is admissible for the pair {Ti, li) if i £ {2, 3, . . . , n} \ {m}. 

• The shifted labeling \m-i is weakly R-admissible for the pair {T„-i,\„i). 

If the function i : i? — > [m — 1], which manifests the weak R- admissibility is not injective then the (n,m,R)- 
Gelfand-Tsetlin tree sequence comes along with a set of dominating vertices as described in Definition\3^ 
all choices are possible. We let Cn.m,R{T , k) denote the set of these sequences. For an integer p < m, we denote 
by £„.j„_p(7", k) the union over all p-subsets R of [to]. Concerning the sign, we define 




(4.3) 



SgnL = (— l)'^ of inversion 

We let Ln^m,B.{T,'k), respectively L„,,„^p 



j/ L _ ^ 1)^ of vertices r ^ R s.t. r is the minimum of i{r)' ^ ggj^ 

p(7~, k), denote the signed enumeration of these objects. 
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Figure 9. An i?-admissible labeling; the vertices of R are enclosed by squares. 

The following is obvious but crucial: the quantity L„^m j^(7~, k) does not change if we pass in Definition 2] 
from weak i?-admissibility to i?-admissibility as changing the dominating vertex from one endpoint of a shared 
edge to the other is a sign-reversing involution. 

We are in the position to give the combinatorial interpretation for the expression in (14.21) . In order to state 
the result, we introduce a convenient notation: if i? = {ii, . . . , ip] C [n] then 

Ak,/(k) := Afe,^ ••.Afe,^/(fci,...,A„). 

(The analog convention for i?kn/(k) will be used below.) 

Proposition 1. Let RC [n]. Then Ak„-Zvn(T, k) — i„.„^/j(T, k). 

This immediately implies the following combinatorial interpretation for the left-hand side of (|4.ip . 
Corollary 1. Let p e {0,1, ... ,n} . T/ien ep(Afci , . . . , Afc„)L„(T, k) = i„^„,p(T, k). 

The following lemma is used in several places of our proofs in the remainder of this section. 

Lemma 4. For an integer t < m, we fix a set P of pairs of edges of Tt+i and let i3n.m,_R,p(7~, k) denote the 
subset of labeled tree sequences in Cn.m,R{'T,^) such that for each pair in P the edge labels of the respective 
edges ofTt-^^i are distinct. Then the .signed enumeration of this subset is equal to the signed enumeration of the 
whole set. 



Proof. We consider the complement of Cn,m,R.p{T,yi) and suppose that for {i,j) G P the edge labeling 
It -|- (1, 2, ... , t) of Tf+i is equal in the coordinates i and j. If there is more than one pair then we choose the 
pair which is minimial with respect to the fixed order on P. Then, we may replace the tree Tt in T by a tree 
where vertex i and j are adjacent. The assertion follows as such as tree does not possess an admissible edge 
labeling. □ 

Proof of Proposition^^ We consider subsets of £„ (7~, k) indexed by two disjoint subsets P,Q ^ [n] of vertices 
of r„: let £„(T, k, P, Q) denote the set of Gelfand-Tsetlin tree sequences in £„(?', k) such that for the edge 
labeling 1 S Z"^^ of the largest tree r„ in the tree sequence T the following is fulfilled: 

• For each p Cz P, there exists an edge of T„ incident with p such that kp+p is the minimum of 
and +i(p) = kp+ p. 

• For each q € Q, there exists an edge in T„ incident with q such that kg + q is the maximum of 

and li(q'i + i{q) = kg + q - 1. 
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We denote the respective signed enumeration by Ln{T, k, P, Q). Suppose r ^ P,Q. Then 

Afc^L„(r, k, P, Q) = EkMT, k, P, g U {r}) - L„(r, k, P U {r}, Q). 

In order to see this, consider an element of Ek^Cn{T,\f., P,Q) with the fohowing property: for each edge i' of 
r„ that is incident with vertex r of T„ and such that the vertex label of the other endpoint of i' is smaller than 
kr + r + 1 we have that the respective edge label li + i is smaller than kr + r. In this case, we may change the 
vertex label of r to fc^ + r to obtain an element of Cn{T, k, P, Q) \ Cn{T, k, P U {r}, Q). Thus, these elements 
cancel in the difference on the left-hand side and we are left with the elements on the right-hand side. 

This implies by induction with respect to the size of i? C [n] that 

Ak«L„(r, k) - ^ (-l)l^l+l«li?k,j^„(r, k, P \ Q, Q). (4.4) 

QQR 

The right-hand side is in fact equal to the signed enumeration of £„^„_fl(7~, k): in order to see this, we may 
assume by Lemma[l]that the edge labels of T„ are distinct, both in £n.n,R{T, k) and in Ei^^CniT, k, P \ Q, Q). 
This implies that for each tree sequences in Ey^^Cn{T,\i.,R \ Q,Q) and each r ^ R, there is a unique edge 
i(r)' of Tn with + *(^) = kr + r. Now, we may convert elements of E^^ CniT , k, P \ Q, Q) into elements 
of Cn^n,BiT,i^) by decreasing the labels of the vertices in Q by 1. We obtain elements, where for r E Q, the 
vertex label kr + r is the maximum of i{ry and, for r e P \ Q, the vertex label kr + r is the minimum of ?(r)' 
- attached with a sign according to the number cases where fc^ -t- r is the minimum of the edge i(r)'. The fact 
that the edge labels are distinct and since there always exists an edge label that is equal to kr + r implies that 
it is irrelevant that the intervals for the possible labels of the edges incident with r were slightly changed when 
passing from PkQ'C„(7', k, P \ Q,Q) to >C„,„,_r(T, k). 

However, by decreasing the vertex label of a vertex q E Q oi an clement in PkQ'C„(T, k, P \ Q, Q) by 1 to 
kq + q, this value may reach the vertex label kp + p of a vertex p that is adjacent to q; in this case we have to 
guarantee that kq + q can still be identified as the maximum of the edge j' connecting p and q. The assumption 
implies i{q) = j. If p ^ P then, when considering the labeled tree sequence as an element of £„_„.ij(T, k), the 
vertex q is the maximum of j' by definition. If, on the other hand, p E R, then we also have i{p) = j and we let 
q be the dominating vertex of the edge to remember that it used to be the maximum of the edge j' . Thus it is 
clear how to reverse the procedure. □ 

In the definition of the P-admissibility, we have fixed a set P of vertices of T. However, we may as well fix 
the image i{R) —: R' of the injective function z : P [n — 1], which corresponds to a set of edges of T. 

Definition 5. Let T he an n-tree, k G Z" and R' C [?i — 1]. A vector 1 £ Z"~^ together with a function 
t : R' ^ [n] is said to he P'-edge-admissible for the pair (T, k) if 1 is t{R')-admissihle for the pair (T, k), 
where t~^ : t{R') [n — 1] is the function that proves the t{R')-admissihility. 

In analogy to Definition [4j it is also clear how to define Gelfand-Tsetlin tree sequences associated with a 
triple (n, m, P'), where m < n are positive integers and P' C [m — 1] corresponds to a subset of edges of Tm- 
We denote this set by £^„(7~, k) and by L^^{T, k) its signed enumeration. Note that Cn,m.p{T, k) is also the 
union of £^^(T, k), where P' is a p-subset of [m — 1]. 

In the proof of the next proposition, it will be helpful to replace the P'-edge-admissibility in the definition 
of L^,„(7~, k) by a more general notion, which we call weak R' -edge-admissihility and define as follows. 

Definition 6. Let T he an n-tree, k G Z" and P' C [n — 1]. A vector 1 G is said to he weakly P'- 

edge-admissible for the pair (T, k) if there exists a function t : R' ^ [n] such that the following conditions 
are fulfilled. 

• For all r G R, the edge r' of T is incident with the vertex t{r) of T and Ir + r = ki(^r) + ^(^)- 

• For all r G [n — 1] \ R' , we have min(A:p ~\- p,kq + q) < Ir + r < max(/cp + p,kq + q), where r' = (p, q) in 
T. 

The sign we associate is defined as follows: each inversion contrihutes a —1 as well as each edge r' of R' such 
that t{r) is the minimum of the edge. (Lf the two vertex lahels of an edge r' coincide then it must he an element 
of R' and we define t(r) as the "maximum" of the edge.) 
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Figure 10. Situation in the proof of Proposition [51 

To obtain the ordinary edge-admissibihty we have to require in addition that for all r £ i?' the following is 
fulfilled: suppose s' is an edge of T incident with vertex t{r) such that Is + s = kf.(^r) + t{f) then we have r — s. 
However, the violation of this condition would require two edges of T to have the same label, which can be 
avoided for an element of L^„j(T, k) by the argument given in Lemma 3] 

The following proposition will finally imply (|4.ip . 
Proposition 2. Let i? C [m — 1]. Then L^,„(T, k) — Ln.,n~i,R{T,ii) ■ 

An immediate consequence is the following. 

Corollary 2. Let p be a non-negative integer. Then Ln.m,p{T,'k.) = L„^„i_i^p(T, k). 

The corollary implies Ln.m,p{T ^ k) = if p is non-zero as Cn,m,p{T ^ k) = if p > m, since there is no injective 
function from [p] to [m — 1]. By Corollary [1] (j4.ip finally follows. 

Proof of Proposition\^ We restrict our considerations to the case that m = n as the general case is analog. 
By LemmaHl we assume that the edge labels of T„_i are distinct, both in >C^_„(T, k) and in Cn,n~i,R[T ^\^)■ 

We consider an element of £^„(7", k), denote by 1 G Z"~^ the respective shifted edge labehng of T„ and by 
t : i? — > [n] the function that proves the weak i?-edge-admissibility of the vector 1 for the pair (T„,k). Suppose 
r € R and that p, q are the vertices of the edge r' in T„ then we have either t{r) = p ot t(r) = q. We denote the 
first subset of C'^^{T, k) by Mr^p and the second subset by Mr^q- The situation is sketched in Figure [TUl 

Assuming w.l.o.g. that fcp + p < fc^ + we first observe that we can restrict our attention to the case that 
there is at least on edge incident with vertex r in T„_i, the label of which lies in the interval [kp + p,kq + q). 
This is because for the other elements, Ir + r ^ kq + q and t{r) q induces a sign reversing bijection from Mr^p 
to Mr.q. In the following, we address these edges as the relevant edges of r. 

In order to construct an element of >C„,„_ij^(T, k) we perform the following shifts to the labels Ir + r for 
all r E R: if the fixed element of ^{T , k) is an element of Mr.p, we shift Ir + r to the minimum of incident 
edge labels in T„_i no smaller than kp + p and let j(r-)' be the respective edge, while for elements of Mr^q we 
shift Ir + r to the maximum of incident edge labels in r„_i smaller than kq + q and let j(r)' be the respective 
edge. These edges j{r) are unique as the edge labels are assumed to be distinct. The contribution of —1 to the 
sign of the elements in M^.p that comes from the fact that the edge label of r' in r„ is equal to the minimum of 
the edge translates in the new element into the contribution of —1 of the edge in r„_i as its edge label is 
also equal to the minimum of the edge. If this procedure causes two distinct vertices r, s G i? to share an edge 
j(r)' = j(s)' then we let the dominating vertex be the maximum of the respective edge in the original element. 

The precise description of the elements in £„_„_i ^(T, k) that appear as a result of this procedure is the 
following. For each r G R, one of the following two possibilities applies: suppose p, q are the endpoints of r' in 
T„ and w.l.o.g. kp + p < kq + q then either 
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• the vertex r is the minimum of the edge and the edge label of j{ry is the minimum under all 
relevant edges of r, or 

• the vertex r is the maximum of the edge j(r)' and the edge label of is the maximum under all 
relevant edges of r. 

For such an element it is also clear how to invert the procedure to reobtain an element of i3^ „(7~, k). 

Finally, we define a sign-reversing involution on the set of elements of Cn,n-i,R{T , k) that do not fulfill this 
requirement: suppose that r G i? is minimal such that the requirement is not met and that r is the minimum 
of the edge Let i' be the relevant edge of r, the edge label of which is maximal with the property that it 

is smaller than Ir + r. We shift Ir+r to this edge label and set i{r) = i. If necessary we choose the dominating 
vertices such that the set of inversions remains unaffected. Then, r is the maximum of the edge jir)' . Likewise 
when r is the maximum of the edge. The fact that we only work with relevant edges guarantees that we are 
able to perform the shift accordingly for the edge label of r' in r„. □ 

To conclude this section, we demonstrate that also (j4.ip implies that L„ (7~, k) is a polynomial in fci , . . . , fc„ 
of degree no greater than n — 1 in every fc^. 

Lemma 5. Suppose that A{ki, . . . , fc„) is a function with 

ep(Afe,,...,AfcJA(fci,...,fc„) = 

for all p>0. Then A^^ . . . , fc„) for all i e {1,2, ...,n}. 

Proof. We define 

Ap^i{ki,. . . , fc„) = ep(Afci , . . . , Afc,, . . . , AkJA{ki, . . . , fc„), 
where A^^ indicates that A^. does not appear in the argument. We use the identity 

^pi^lj • • ■ : ^n) — ep{Xi, . . . , Xi, . . . , Xn) + Xiep-i{Xi, . . . , Xi, . . . , Xn) 

and the assumption to see that 

Ap_i(fci, . . . ,fc„) = -Afc;Ap_i^j(fci, . . . , fc„). 

This implies 

Ap,,(fci,...,fc„) = {-l)PAPA{ki,...,kn) 
by induction with respect to p. As An^i{ki, . . . , fc„) = 0, the assertion follows. □ 

5. Monotone triangles 

I would like to see an analog "theory" for monotone triangles (Gelfand-Tsetlin patterns with strictly increasing 
rows), which seems conceivable as there are several properties of the unrestricted patterns for which we have 
a corresponding (though in some cases more complicated) property of monotone triangles. For instance, it is 
known that the number a{n; fci, . . . , A;„) of monotone triangles with bottom row fci, fc2, . . . , fc„ is given by 

n iE..+E-yE,^E-;) n h^j^±2^^ n i^^+^M n (s.d 

l<p<q<n l<i<j<n l<p<q<n l<i<j<n 

where '■— id —E^^. To start with, we give four different (but related) combinatorial extensions of a(n; fci, . . . , fc„) 
to all (fci, . . . , fc„) e Z" in this section, and then present certain other properties of a{n\ fci, . . . , fc„), for which 
it would be nice to have combinatorial proofs of the type as we have presented them in this article for Gelfand- 
Tsetlin patterns. This is because these properties imply, on the one hand, (|5.ip and, on the other hand, the 
refined alternating sign matrix theorem. The latter will be explained at the end of this section. 



16 



ILSE FISCHER 



5.1. Four combinatorial extensions of a{n; ki, . . . , kn) to all (fci, . . . , fc„) e Z". The quantity a{n] ki, . . . , kn) 
obviously satisfies the following recursion for any sequence (fci, ^2, . . . , fc„) of strictly increasing integers. 

a{n;ki,...,kn) = ^ Q;(n - 1; /i, . . . , /„_i) (5.2) 

(!i.....i„_i)ez"-i 

fcl<il<fc2<i2<fc3<-<fcTi-l<^Ti-l<'i^7i'^i?^'i + l 

To obtain an extension of the combinatorial interpretation of a{n\ fci, . . . , fc„) to all (fci, . . . , fc„) G Z", it is 

6 

convenient to write this summation in terms of "simple" summations ^ i-C- summations over intervals. 

i—a 

a~l b 

This is because we can then use the extended definition of the summation, i.e. J2 /(*) = ^ and J2 /(*) = 

i—a i—a 

a-1 

— ^ f(i) if 6 + 1 < a — 1. Note that if p(i) is a polynomial in i then there exists a polynomial q{i) with 

i=h+l 

b 

Aiq{i) — p{i), which implies ^ p(i) = (7(6 + 1) — q{a) ii a < b and, consequently, that this sum is a polynomial 

i—a 

in a and 6. The extension of the simple summation we have just introduced was chosen such that the latter 
identity is true for all a, & G Z. After we have given at least one representation of the summation in (j5.2p in terms 
of simple summations, this shows that a{n] ki, . . . , can be represented by a polynomial in fci, ^2, . . . , fc„ if 
ki < k2 < ■ ■ ■ < kn- (This polynomial is in fact unique as a polynomial in fci , ^2 , • ■ • , is uniquely determined 
by its values on the set of n-tuples (fci, fc2, . . . , fc„) G Z" with fci < fc2 < . . . < fc„.) The extended monotone 
triangles with prescribed bottom row fci , fc2 , . . . , fc^ will be chosen such that these objects are enumerated by 
this polynomial for all (fci, . . . , fc„) G Z". In particular, it will certainly not be the naive extension, which sets 
a(n; fci, ... , fc„) — if fci, fc2, . . . , fc„ is not strictly increasing. 



5.1.1. First extension. If we assume that fci < fc2 < . . . < fc„, then one possibility to write the summation in 
(|5.2p in terms of simple summations is the following: we choose a subset {/^j, li^, . . . , li^} C {Zi, . . . , In-i} for 
which we have — ki.. For all other Iq we have kg < Iq < fc^+i, except for the case that q + 1 = ij for a j, 
where we have kq < Iq < fcg+i. More formally, 

k2 ks ki^—1 ki-^ ^ip~^ ^ip kn 

E E E E - E E - E E - E 

p>0 l<ii<i2<---<ip<n— 1 ii=fci + l (2=^2 + 1 'ii -l=fcij -1 + 1 iij =fcij iip-i=fcip-i + l iip=fcip i„_i=fc„_i + l 

where in the exceptional case that = 1+1 the expression ^ ^ is replaced by ^ ^ . 

L . _i — fci . _ 1 + 1 L . — fci . L . .—fci. . L . — fci . 

This leads to the following extension: a monotone triangle of order n is a triangular array (aij)i<j<i<„ of in- 
tegers such that the following conditions are fulfilled. 

• There is a subset of special entries aij with i < n for which we require a^j — a^+ij-. We mark these 
entries with a star on the left. 

• If ttij is not a special entry then we have to distinguish between the case that a^j is the left neighbour 
of a special entry or not. 

— If flij+i is not special (which includes also the case that flij+i does not exist) then Oi+i j- < a^j < 
Oi+ij+i in case that Ui^ij < Oi+i.j+i and a^+ij+i < Uij < ai+i,j otherwise. (There exists no 
pattern with fli+ij- = a^+ij+i.) In the latter case we have an inversion. 

— If Oij+i is special then fli+ij < a^j < a^+ij+i or a^+ij+i < Uij < ai^ij. (There exists no pattern 
with fli+i.j+i = fli+i J + 1.) In the latter case we have an inversion. 

The sign of a monotone triangle is —1 to the number of inversions. Then a(n; fci, ... , fc„) is the signed enumer- 
ation of monotone triangles with a„^i = ki. Here is an example of such an array. 
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3 

*2 6 

2 4 *6 

3 *1 6 7 
3 17 5 8 

5.1.2. Second extension. The summation can also be written in the following more symmetric manner: we 
choose a subset / C [n — 1] such that = fc^ if i e / and a subset J C [n — 1] such that Ij — fc^+i if j G J. The 
sets /, J have to be disjoint and, moreover, i G / implies i — 1 ^ J (which is equivalent to (/ — 1) n J = 0). On 
the other hand, ii h G [n — 1] \ (/ U J) then kh < Ih < kh+i- Equivalently, 

E E E - E E - E E - E > 

P.9>0 i=in, --,'p},J=Oi, --,Jq}Qb^~'^] h, =ki. U =ki Ij, =/cj, +i 'j„=fcj„ + i 'h, =fch, +1 'h,.=fehr + l 
/nj=0,(/-i)nj=0 

where [n — 1] \ (/ U J) = {/ii, . . . , /i^}- Using this representation, we can deduce the following extension: a 
monotone triangle of order n is a triangular array {ai.j)i<j<i<n of integers such that the following conditions 
are fulfilled. 

• There is a subset of "left-special" entries a^j- with i < n for which we require ajj- — a^+i j and we mark 
them with a star on the left as well as a subset of "right-special" entries Uij with i < n for which we 
require ai,j = Oi+ij+i and mark them with a star on the right. 

• An entry can not be a left-special entry and a right-special entry. If a right-special entry and a left- 
special entry happen to be in the same row then the right-special entry may not be situated immediately 
to the left of the left-special entry. 

• If aij is not a special entry then we have fli+ij < aij < a^+i j+i or a^+i j+i < aij < aj+i j , respectively. 
In the latter case we have an inversion. 

Next we give an example of such an array. 

3 

2 4 

3 *2 6 

*3 2 5* 7 
3 17 5 8 

The sign of a monotone triangle is again —1 to the number of inversions and a(n; fci, . . . , fc„) is the signed 
enumeration of these extended monotone triangles with prescribed a„^i = ki. Although we think that the fourth 
extension is probably the nicest, the first two extensions are the only ones where in case that fci < fc2 < . . . < fc„ 
the removal of all stars leads to a monotone triangle in the original sense and no array is assigned a minus sign, 
i.e. we have a plain enumeration. 

5.1.3. Third extension. Another possibility to write the summation in (j5.2p in terms of simple summations is 
the following. 

/C2 ^3 ^il ^il ^ip ^ip fc^ 

EM)^ E E E- E E - E E - E 

p>0 2<n<i2< - <»P<"-l /l=fel ;2 = fc2 Zi^_l = fci^ Zi^=fci^ li^_i=ki^li^=ki^ Z„_l=fc„_l 

This leads to the following extension: a monotone triangle of order n is a triangular array (aij)i<j<i<„ of 
integers such that the following conditions are fulfilled. The entries ai_ij_i and a^-ij are said to be the 
parents of a^j . 

• Among the entries (aij)i<j<i<„ we may have special entries such that if two of them happen to be 
in the same row they must not be adjacent. We mark these entries with a star. For the parents of a 
special entry a^j we have require ai-ij-i — Uij — Oi^ij. 

• If Qij is not the parent of a special entry then a^+ij < Uij < Oi+ij+i and Oi+ij+i < aij < Ui+ij, 
respectively. In the latter case we have an inversion. 
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In this case, the sign of a monotone triangle is —1 to the number of inversions plus the number of special entries. 
Then a{n; fci, . . . , is the signed enumeration of monotone triangles with an,i — ki. Next we give an example 
of such an array. 

4 

5 3 
5 5 
3 5 2 

4 17 

This is the extension that has already appeared in [5]. There we have indicated that the non-adjacency 
requirement for special entries can also be ignored: suppose that (a^ j)i<j<i<„ is an array with the properties 
given above accept that we allow special entries to be adjacent: suppose a^.j and ,j+i are two adjacent special 
entries such that i+j is maximal with this property. Then we have ai-ij-i = a^j = ai^ij = Oi j+i = ai_i.j+i. 
This implies that ai-2,j-i = = o,i-2,j whether or not ai-i_j is a special entry, which implies that changing 

the status of the entry ai-ij is a sign-reversing involution. 




5.1.4. Fourth extension. In order to explain the representation of (j5.2p in terms of simple summations which is 
used for the third extension, it is convenient to use the operator Vx,y := E^^ + Ey — E~^Ey. Then 



fcl<!l<fc2<i2< - <'=„-l<i,i-l<fcn, ll=k', l2=k' i„-l = 



k',=ki 



if fci < ^2 < • ■ • < fcn is strictly increasing. (Note that Vfcj.fc^ as well as Vk„,k'^ can also be removed as the 
application of Vx^y to a function which does not depend on x and y acts as the identity. In order to convince 
oneself that this is indeed a valid representation of the summation in (j5.2p . one can use induction with respect 
to n to transform it into the representation of the first extension.) This leads to the following extension, which 
we think is the nicest: a monotone triangle of order n is an integer array (aij)i<j<i<„ together with a function 
/ which assigns to each Oij an element of {<—,—?•, o} such that the following conditions are fulfilled for any 
element a^.j with i < n: we have to distinguish cases depending on the assignment of the arrows to the elements 
o-i+ij and a,;+ij+i. 

(1) /(oi+ij) =<— , /(ci+ij+i) =^, O : fli+ij- < Oij < a,;+ij+i or Oi+ij+i < Oij < Oi+ij 

(2) /(fli+ij) =<— , ./(oj+ij+i) =^ '■ < o,i,j < or ai_|_ij-+i < a^j- < a^+ij- 

(3) /(fli+ij-) =<^, /(oi+ij+i) =<— , : ^i+id < ^id < flj+ij+i or Oj+ij+i < Oij' < 

(4) /(fli+ij) =<->,-5-, /(aj+ij+i) =^ ■ Oi+ij < flij < Oi+ij+i or a^+ij+i < Oij < a.j+ij-. 

In Case 1 and Case 4, there exists no pattern if a^+ij = Qi+ij+i, in Case 2, we have no pattern if fli+ij = 
Oi+ij+i -|- 1 and, in Case 3, there is no pattern if a^+ij+i — fli+ij -I- 1. In each case, we say that a^j is an 
inversion if the second possibility applies. We define the sign of a monotone triangle to be —1 to the number of 
inversions plus the number of elements that are assigned the element "o". Then a{n; fci, . . . , fc„) is the signed 
enumeration of monotone triangles (aij)i<j<i<„ of order n with a„.i — ki. Here is an example. 







•H- 








•<— 
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<— 


6 
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■h- 


6 


^■ 


7 


«■ 


6 


— s- 


7 


— 5- 


1 




8 




5 



2 6 7 5 

— i- «■ — S- — 5- — > 

3 18 5 4 

In order to see that this extension comes from the presentation given above, note that, when expanding 

Vfci,fei Vfc2,fe^ • • • Vk,^^k'^ = (E'jT^^ + Ek[ - E^^Ek'J{E^^ + Ek'^ - E^^E^'^) ■ ■ ■ {E'^:^ + Ek'^ - E'^^Ek'J, 

the assignment of " to the entry ki in the bottom row corresponds to choosing E'^^ from the operator V/j.^t' , 
while the assignment of "— J>" to hi corresponds to choosing E'^' and the assignment of corresponds to 
choosing E^j^^E^.' . 
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In all cases, the combinatorial extension of a{n; ki, . . . , kn) is, generally speaking, a signed enumeration, 
which reduces to a plain enumeration in the first and in the second case if fci, ^2, ■ • • , is strictly increasing. 
This can be generalized as follows. 

Proposition 3. Suppose ki, k2, . . . , fc„ is a weakly increasing sequence of integers then a{n] fci, . . . , fc„) is the 
number of Gelfand-Tsetlin patterns with prescribed bottom row fci, . . . , fc„ and where all other rows are strictly 
increasing. 

Proof. In order to see this, we use the first extension. Suppose kj — fcj+i and {a,i.j)\<j<i<n is a respective 
pattern. As a„j = a„j+i it follows that cin-ij equal to this quantity as well and at least one of a„_i.j and 
an-i,j+i must be special. We can exclude the latter possibility by the following sign reversing involution on the 
extended monotone triangles where a„_i.j+i is special in such a situation: let j be maximal with this property. 
Then, changing the status of a„_ij (from special to not special or vice versa) is a sign reversing involution. 
Thus we can assume that Un-ij+i is not special (and, consequently, a„_ij must be special) whenever we have 

This can be used to show that a{n; fci, . . . , fc„) = if there are p, q with l<p<q<n— 1 such that 
kp = fep+i, kq = fcq+i and kj + 1 = fc^+i for p < j < q, which is one special case of the statement: as an-i,p+i 
can be assume not to be special (which already settles the case q = p + 1) we can deduce that an-i,p+2 is not 
special (otherwise we would have no choice for a„_i_p+i) and, by iterating this argument, we can see that an-ij 
is not special for p+1 < j < q-l. This implies that a„_i^p+i = a„,p+2, an-i,p+2 = an,p+3, • • • ,an-i,9-i = a„,g. 
On the other hand, the fact that a„_i.q is special implies a„_i^g_i — an,q~i, which is a contradiction. 

Thus we may assume that such p, q do not exist for our sequence fci, ^2, . . . , k„. Consequently, if kj — fcj+i 
then fcj-i < kj and fc^+i < fcj_|_2- As a„_ij- is special and a„-i_j+i is not, we have a„_i.j_i < a„_i.j < 

It should be remarked that the signed enumeration in the first and in the second extension is in general not 
a plain enumeration if fci , . . . , fc„ is weakly increasing but not strictly increasing. Also note that the proposition 
is equivalent to the fact that, for weakly increasing sequences fci, fc2, . . . , fc„, the application of the summation 
in (j5.2p to a{n — 1; li, . . . , In-i) is equivalent to the application of the representation of this summation in terms 
of simple summations to a{n — 1; Zi, . . . , In-i)- (If the sequence is not increasing then the summation in (j5.2p 
is over the emptyset and therefore zero.) As a next step, it would be interesting to figure out whether there 
is a notion analog to that of Gelfand-Tsetlin tree sequences for monotone triangles. This could be helpful in 
understanding the properties of a{n; fci, ... , fc„), which we list next. 

5.1.5. Properties of a{n; fci, . . . , fc„). In previous papers we have shown that a(n; fci, ... , fc„) has the following 
properties. 

(1) For n > 1 and i G {1, 2, . . . , n — 1}, we have 

(id +Ek^_^^E~^ Ski, k,+i)Vki,ki+ia{n; ^i, . . . ,fc„) = 0. 

(This is proved in [3].) 

(2) For n > 1 and i G {1, 2, . . . , n}, we have degj,. a{n; fci, ... , fc„) < n — 1. (See [F.) 

(3) For n > 1, we have a(n; fci, ... , fc„) = (— l)"~^a(n; fc2, . . . , fcn, fci — n). (A proof can be found in [4 .) 

(4) For n > 1 and p > 1, we have 

ep(Afcj , . . . , Afe„)a(n; fci, . . . , fc„) =0. 

(See Lemma 1 in |3].) 

The first property is obviously the analog of the shift- antisymmetry of L„(T, k) as the latter can obviously be 
formulated as follows. 

(id+£;fe,^,£;-/5fc,,fe,^jL„(r,k) = o 

It is interesting to note that a special case of this property for a{n; fci, ... , fc„) follows from Proposition [3] if we 
specialize fc^+i — fc^ — 1 then the first property simplifies to 

a{n; fci, ... , fci_i, h - 1, fc^ - 1, fci+2, . . . , fc„) -1- a(n; fci, ... , ki^i,ki,ki,ki+2, • • • , fcn) 

- a(n; fci, ... , fci_i, h - 1, ki, fci+2, . . . , fc„) = 0. 
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However, for integers fci, fc2, • ■ • , fci, fci+2, • • ■ , with ki < k2 < . . . < < fc^ — 1 and ki < ki^2 < 

. . . < fc„_i < kn, Proposition [3] implies this identity: in a monotone triangle {ai_j)i<j<i<n with bottom 
row ki, . . . , ki — 1, fci, ki^2, ■ ■ ■ ,kn we have either a„_i_i = /c^ — 1, which corresponds to the case that 
we have ki, . . . , ki — l,ki — 1, ki^2, ■ ■ ■ ,kn as bottom row, or Qn-i.i — ki, which corresponds to the case 
that fci, . . . , ki-i, ki,ki, ki+2, . . . , fcn is the bottom row. As a polynomial in /ci, /c2, ■ • ■ , fcj, . . . , fc„ is uniquely 
determined by its values on the set of these elements (fci, k2, ■ ■ ■ , ki, fci+2, . . . , fc„) £ Z"~^, the identity follows. 

Concerning the second property, we have seen that it also holds for £„(T, k). Both properties together 
actually imply (I5.2p . see [31, and thus it would be interesting to give combinatorial proofs of these properties. 

5.1.6. Property (3) implies the refined alternating sign matrix theorem. The third property is interesting as it 
holds also for Gelfand-Tsetlin patterns where it can easily be deduced from the shift-antisymmetry. However, 
it is a mystery that it also holds for monotone triangles, as we do not see how it can be deduced from the first 
property. Quite remarkably, it can be used to deduce the refined alternating sign matrix theorem as we explain 
next. 

The number j4„.i of n x n alternating sign matrices, where the unique 1 in the first row is located in the 
i-th column is equal to the number of monotone triangles with bottom row 1,2, ... ,n and i appearances of 1 
in the first NE-diagonal, or, equivalently, the number of monotone triangles with bottom row 1,2, ... ,n and 
i appearances of n in the last SE-diagonal. (This follows immediately from the standard bijection between 
alternating sign matrices and monotone triangles.) If we assume that ki < k^ < . ■ . < kn, then the number of 
"partial" monotone triangles with n rows, where the entries a„,i,a„_i,i, . . . ,an~i+i,i are removed, no entry is 
smaller than ki and an,i — ki for i — 2,Z, . . . ,n in equal to 

(A proof is given in j6j.) In fact, it follows quite easily by induction with respect to i as 
/ \ 



E 



a{li, . . . , In-l) 



E 



a{ki,l2, ... , In-l)- 



J 



(i2,...,i„_i)ez"-^ 



. (ii,...,i„_i)ez"-i 

\ki<li<k2<l2<k3<...<k^_l<l^_l<kji,l^yf:l^_^_l 

This implies the first identity in 

The proof of the fact that the first expression is also equal to the last expression is similar. Therefore, by 
Property (3), 

= (-1)'+"A^7 k2,..., fc„, fci - ^)|(fe,,...,fc„)=(i,i,2,...,„_i) 

- i-ir-S^'E-^-+^^^a(n; fc2, . . . , fc„, fci)|(,,,...,,„,,,).(i,2,...,„_i,„_i) • 

We use E^"" = (id -(5^)'" ^ (7)(-l)^''5^ to see that this is equal to 



2n-l-i 
3=0 



3=0 

2n-l-{ 
j 



^ {-iy5{^a{n; fc2, . • . , fc„, fci) 



(*;2,...,fc„,fei) = (1.2,...,n-l,n-l) 

2n-l-i 



3=0 \ / 

This shows that the refined alternating sign matrix numbers An^i are a solution of the following system of linear 
equations. 



fe=i 



k — i 



l<i<n 
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In [1], it was shown that this system of hnear equations together with the obvious symmetry An^i — A„^n+i-i 
determines the numbers An^i inductively with respect to n. 

It is worth mentioning that a similar reasoning can be applied to the doubly refined enumeration ,j ^ of 
n X n alternating sign matrices with respect to the position i of the 1 in first row and the position j of the 1 
in the last row. This number is equal to the number of monotone triangles with bottom row 1, 2, . . . , n and i 
appearances of 1 in the first NE-diagonal and j appearances of n in the last SE-diagonal, which implies (see 
[S]) that 

A^,,^i-iy-'Al-'S^^'a{n;h,...,kJ 

{ki,...,kn) — {2,2,...,n — l,n — l) 

Using the first and the third property of a{n; /ci, . . . , k^) displayed above we deduce the fohowing identity. 

(id+£;^"-i£;^-"+i5fc,,fcJI4„,fcia(n; fci, . . . , fc„) 

= (-l)"-i(id +E'ii::'E^;'+'Sk„kjVk„,kMn-, k2,..., kn, ki - n) = 
We apply {—ly^^ A^j^^ SjT^ to the equivalent identity 

= a{n; fci, . . . , fc„) + Akjk„a{n; fci, . . . , fc„) 
^^_2„+4^2„-4^(^. fc^_„_,.3^ . . . , kn-i,ki+n-3)+E,:^^'"+^El'^-^Sk,AkMn; kn-n+3, fca, ■ • • , fc„-i, fci+n-3) 
to see that 

- {-iy-^Al~'5i-'a{n; fci, . . . , fc„) - {-ly A^Si^ain; fci, . . . , fc„) 

+ £;,-2n+3+.^2„-3-,^_^),-i^.-i^,-i^^^. k„-n + 3,k2,..., fc„_i, fci + n - 3) 

+ E^^^''+^+'El'^-''-\-iy~'6lAi^a{n; fc„ - n + 3, fca, . . . , fc„-i, fci + n - 3). 

Now we use the expansions 

2 n-3 -i ,^ _ Q _ x 



p=0 

and 



V 



2n-3-j 

/ Z/t — 

,=0 V 
to see that 

= {-\y-^ AXy^7y{n- fci, . . . , fc„) - (-l)'A'fe/^^a(n; fci, ... , fc„) 

^ 2„g , 2„g , - 3 - z\ /2n - 3 - j\ fc„ _ n + 3, fc2, . . . , fc„-i, fci + n - 3) 

p=0 (?=0 ^ ^ ^ ^ ' 

+ E ^ r" M ^ (-ir-i+''5^+W,Xn;fc„-n + 3,fc2,...,fc„-i,fci+n-3). 

We evaluate at (fci, fc2, . . . , kn-i, kn) = (2, 2, 3, . . . , n — 2, n — 1, n — 1) to arrive at 

p=0 9=0 ^ ^ ^ ^ ^ ^ 

Computer experiments led us to the conjecture that this identity together with the obvious relations A^ ^ ^ = 
A^ J j and A^ ^ j — A^ n+i-i n+i-j determine the doubly refined enumeration numbers A^ ^ j uniquely induc- 
tively with respect to n. 
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5.1.7. Property (1) and (4) imply Property (3). The analog of the fourth property is true for Gelfand-Tsethn 
tree sequences, see (j4.ip . for which we gave a combinatorial proof in Section^ The significance of this property 
is that it can be used to deduce the third property from the first property. Since every symmetric polynomial 
in Xi, X2, . . . , Xn can be written as a polynomial in the elementary symmetric functions, this property implies 
that 

p{Eki , . . . , Ekja{n; fci, . . . , fc„) = 1, . . . , l)a(n; fci, . . . , fc„) 

for every symmetric polynomial p{Xi, . . . , Xn) in Xi, . . . , Xn- This extends to symmetric polynomials in 
Xi^X^^, . . . , Xn, X~^: let p{Xi, . . . , X„) be such a polynomial and t £ Z such that p{Xi, . . . , X„)X* • ■ • X^ ='■ 
q{Xi, . . . , Xn) is a symmetric polynomial in Xi, . . . , Xn then 

p{Ek^,. . .,EkJain;ki,. . . ,fc„) = Ef.^ ■ ■■El^p{Ek^,. . .,EkJa{n; ki - t, . . . ,kn - t) 

= El^--- El^p{Ek^,. . . , Ekja{n; fci, . . . , /c„) = 1, . . . , l)a(n] fci, . . . , fc„) = 1, . . . , l)a(n; fci, . . . , fc„). 

In particular, this shows that (14. ip is also true if all "A"s are replaced by "<5"s. Now we are ready to deduce 
Property (3) from Property (1) and Property (4): note that the operator Vx,y is invertible as an operator on 
polynomials in x and y: this follows as Vx,y = id+i5a;Ay and 

00 

(The sum is finite when applied to polynomials.) Property (1) is obviously equivalent to 

a(n;fci,...,fcj_i,fci+i + l,fcj - 1, fci+2, ■ • • , fcn) = -Vk,^k,+tVf7^^,.^a{n\ki, . . . ,kn). 

This implies 

fcj, . . . , fc„, fci - n) = (~l)""ia(n; + 1, • ■ • , fcn + 1, fci - n + 1) 

n 
i=2 

Therefore, in order to show the third property, we have to prove that 

(n n \ 

H^fei.fe, - n V'fc^^fci a{n;ki, . . . , fc„) = 0. 
1=2 i=2 / 

This follows from the fourth property as 

n n n n n— 1 n — 1 

n - n ^fc. ^^=1 = n (id +4, Afe. ) - n (id + a,., 4 J = (5,^, ( A^, , . . . , a,. J - ^ A-^^ (4. , . . . , 4 J 

i=2 1=2 1=2 i=2 r=0 r=0 

= X! ('^^1 (^'■(^fei' ■ • -^^kj - Afe,er-i(Afe2,. . ., Afc„)) - Afe^ (er(4i, ■ • • ,4„) - 4ier_i(42, • • ■ ,4„))) 

r=0 

n-1 

= 5^ (<SI^ er{Ak, , . . . , A,J - A^,^e.(4, , • • ■ , 4„ )) 

r=0 

n-1 

~ 51 ('^feiAfeier_i(Afc2,. . . , Afe„) - Afc/fc,er-i(42,- ■ • )<5fc„)) = . . . 

r=l 

n n — s 

= E E(-l)' , ■ • ■ , 4J - .5^+^-1 A-ie,(Afc, , . . . , AfcJ) . 

s— 1 r— 1 
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Figure 11. Non- intersecting lattice paths 

Appendix A. The non-intersecting lattice paths point of view 

In Figure[TTl the family of non-intersecting lattice paths that corresponds to the Gelfand-Tsetlin pattern given 
in the introduction is displayed: in general, the lattice paths join the starting points (0, 0), (—1, 1), . . . , (— n -|- 
1, n — 1) to the end points (1, fci), (1, k2 + 1), . . . , {1, kn + n — 1), where the lattice paths can take east and 
north steps of length 1 and end with a step to the east. As indicated in the drawing, the heights of the 
horizontal steps of the i-th path, counted from the bottom, can be obtained from the i-th southeast diagonal 
of the Gelfand-Tsetlin pattern, counted from the left, by adding i to the entries in the respective diagonal of 
the Gelfand-Tsetlin pattern. By a well-known result on the enumeration of non-intersecting lattice paths of 
Lindstrom [TUl Lemma 1] and of Gessel and Viennot [HI Theorem 1], this number is equal to 

det (A.1) 

l<ij<ri \ I - 1 J 

which is, by the Vandermonde determinant evaluation, equal to (|l.ip . (Note that C'^^j!^^) is a polynomial in 
kj of degree i — 1.) 

Interestingly, another possibility to extend the combinatorial interpretation of (11.11) to all (fci, . . . , fc„) e Z"q 
is related to this interpretation in terms of families of non-intersection lattice paths: for arbitrary non-negative 
integers /ci, ^2, . . . , /cn, consider families of n lattice paths with unit steps to the north and to the east (in general, 
these families are intersecting for the moment) that connect the starting points (0, 0), (—1, 1), ... , {—n + 1, n — 1) 
to the endpoints (0, ki), (0, k2 + 1), . . . , (0, fc„ + n — 1), in any order. (Now we omit the vertical steps at the 
end of the paths.) Suppose that the i-th starting point (— i + l,i — 1) is connected to the Tr^-th end point 
(0, fcjTi + — 1) then the sign of the family is defined as the sign of the permutation (tti, 7r2, . . . , 7r„) = tt. Then, 
(|l.ip is the signed enumeration of families of lattice paths with these starting points and end points. The merit 
of the theorem of Lindstrom and of Gessel and Viennot is the definition of a sign reversion involution on the 
families of intersecting lattice paths, which shows that only the non-intersecting families remain in the signed 
enumeration. Depending on the relative positions of the numbers ki, k2 + I, . . . , kn + n — I, there is only one 
permutation tt for which a family of non-intersecting lattice paths exists at all. This implies that the signed 
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Figure 12. Non-intersecting lattice paths that go below the x-axis. 

enumeration of families of lattice paths reduces essentially (i.e. up to the sign of tt) to the plain enumeration of 
families of non-intersecting lattice paths. 

Finally, it is worth mentioning (without proof) that the requirement that all ki are non-negative can be 
avoided. A close look at the proof shows that this requirement is useful at first place to guarantee that the 
location of the end points is not "too far" to the south of the starting points. If an end point is south-east of a 
starting point then there is obviously no lattice path connecting them which only uses steps of the form (1, 0) 
and (0, 1). However, in such a case it is convenient to allow steps of the form (1, —1) and (0, —1). Moreover if 
we require these paths to start with a step of the form (0,-1) and let each step of the form (1,-1) contribute 
a minus sign, we obtain an interpretation of p.ip for all (fci, . . . , fc„) e Z". A typical situation is sketched in 
Figure HH 

Appendix B. Another proof of the shift-antisymmetry 

We sketch a (sort of) combinatorial proof of the shift-antisymmetry of the signed enumeration of Gelfand- 
Tsetlin patterns with prescribed bottom row which does not rely on the notion of Gelfand-Tsetlin tree sequences. 
The argument is a bit involved and thus shows the merit of the notion of Gelfand-Tsetlin tree sequences. On the 
other hand, it could be helpful for proving the analog property for monotone triangles as we have not established 
a notion that is analog to that of Gelfand-Tsetlin tree sequences for monotone triangles so far, see Section [S) 

The following notion turns out to be extremely useful in order to avoid case distinctions; we define [x,y] := 
{z G Z|a; < z < y} a X < y as usual, [x, x ~ 1] :— % and [x^y] := [y + l,x — 1] if y + 1 < x — I. The latter 
situation is said to be an inversion. By considering all possible relative positions of x, y, z, it is not hard to see 
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that 

[x,y]^[x,z + l] = [y+l,z + l], 

where AAB := {A \ B) U {B \ A) is the symmetric difference. In fact, concerning this symmetric difference, the 
following can be observed: either one set is contained in the other or the sets are disjoint. The latter situation 
occurs iff exactly one of [x, y] and [x, z + 1] is an inversion. On the other hand, 

[z,x]A[y-l,x] - [x + l,z~l]A[x + l,y-2] = [z,y - 2] = [y - 1, z - 1] 

and we have [z, x] \ [j/ — 1, x] 7^ and [y — l,x]\[z,x] / (which implies that the two sets are disjoint) iff 
exactly one of [z,x] and [?/ — is an inversion. 

Let Cn{ki, . . . ,kn) '■— £,i(;B,k) denote the set of Gelfand-Tsetlin patterns with bottom row ki , , . . • , kji 
and Ln{ki, . . . , fc„) :— Ln(B, k) the corresponding signed enumeration. The proof is by induction with respect 
to n. Nothing is to be done for n = 1. Otherwise, it suffices to consider the case j = i + 1. We fix z G 
{1, 2, . . . , n — 1} and decompose £„(fci, . . . , fc„) into four sets: let C\ ^(fci, . . . , fc„) denote the subset of patterns 
(ap,(j)i<g<p<n G 'C„(fci, . . . , fc„) for which the replacement a„_i — > fci+i + 1 and a„^i+i — fc^ — 1 produces another 
Gelfand-Tsetlin pattern (which is obviously an element of Cn{ki, . . . , fei_i, fci+i + 1, fc^ — 1, . . . , fcn) then). If 
we perform this replacement we can either have a contradiction concerning the requirement for := a„_i.i_i 
or for Zi+i :— a„_i.i+i. (There can not be a contradiction for li := an-i,i as k £ [ki,ki+i] if and only if 
li G [fci+i + l,ki — 1].) We let £^ j(fci, . . . , fc„) denote the set of patterns, where we have a contradiction for 
li-i but not for h+i, £^ i{ki, . . . ,kn) denote the set of patterns, where we have a contradiction for Z^+i but not 
for li-i and Cf^ j(fci, . . . , fc„) denote the set of patterns, where we have a contradiction for both li^i and li^i. 
Finally, we let ^(^1, ■ • ■ , kn) denote the respective signed enumerations. We aim to show that 

-(fci, . . . , fc„) = -L;^ -(fci,...,fci_i,fci+i + l,fci - l,fci+2,---fc«) (B.l) 

ifje {1,2,3,4}. 

The case j = 1 is almost obvious, only the sign requires the following thoughts: having no contradiction for 
both li^i and k+i means that k^i G [fci-i, ki] n fc^+i + 1] and li^i e [fc^+i, fci+2] H [ki — 1, fci+2]- This is 

in fact true for patterns in £^ ^(fci, • . • , kn) as well as for patterns in £^ ^(fci, • . • , fci+i + 1, fci — 1, . • . , fcn)- The 
intersection [ki-i,ki] fl + 1] is empty if exactly one of the intervals is an inversion. Thus we may 

assume that they are either both inversions or both not inversions. This implies that k-i is an inversion for the 
patterns on the left if and only if it is an inversion for the patterns on the right. The same is true for h+i. On 
the other hand, li is obviously an inversion on the left if and only if it is no inversion on the right, which takes 
care of the minus sign. 

We show (|B.1|) for j = 2 (the case j = 3 is analog by symmetry): given an element of £^j_,;(fci, . . . , fc„), 
we have k-i G [fci-i, ki] \ [ki^i, fc^+i + 1], whereas for an element of i{ki, . . . , fc^+i + 1, fc^ — 1, . . . , fc„), we 
have li-i e [fci_i,fci_(-i + 1] \ [ki^i,ki]. The conditions for the other elements are the same. (In particular, 
U+i e [fci+i,fci+2] n [ki — l,fci+2]-) If we are in the case that either both sets [fci_i,fci] and [fci_i,fci+i + 1] 
are no inversions or both sets are inversions then one set is contained in the other, which implies that one of 
the conditions for can not be met. However, then the condition for li-i in the other set is that it lies in 
[ki + 1, fci+i + 1]. As the condition for U is that it is contained in [ki, fci+i] it follows, by the shift-antisymmetry 
for n — 1, that the signed enumeration of the patterns in this set must be zero. 

If, however, exactly one set of ki] and [ki^i, fc^+i -I- 1] is an inversion then the sets are disjoint and their 

union is [ki + 1, fc^+i -I- 1]. We decompose the two sets C'^ ^{ki, . . . , fc„) and C"^ ^(fci, . . . , fci+i -f 1, fc^ — 1, . . . , fc„) 
further according whether li G [ki-i — l,ki — 1] or li G [ki^i — 1, /ci+i]. (Observe that also [ki, /ci+i] is the disjoint 
union of [ki^i — l,ki — 1] and [ki^i — 1, fci+i].) By the shift-antisymmetry for n — 1, the signed enumeration of 
the elements in i{ki, ■ ■ ■ , kn) which satisfy h G [ki-i — l,ki — 1] is zero as the requirement for li^i is that it is 
contained in [fci_i, fc^]. Similarly, the signed enumeration of the elements in j(fci, . . . , fci+i -f 1, fc; — 1, . . . , fc„) 
with li G [ki-i — 1, fci+i] is zero. Thus, for the first set, we are left with the patterns that satisfy li-i G [fci_i, ki] 
and li G [ki-i — 1, ki+i] and, for the second set, the patterns with G [/ci_i, ki^i + 1] and k G [h-i — 1, fc^ — 1] 
remain. By the symmetry of these conditions and the shift-antisymmetry for n — 1, we see that the signed 
enumeration of the first set is the negative of the signed enumeration of the second set: as for the sign observe 
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that li^i is an inversion on the left (which is the case iff [/c^-i, ki] is an inversion) if and only if it is no inversion 
on the right (which is the case iff [fc,i_i,/cj+i + 1] is no inversion). The analog assertion is true for k as it is 
an inversion on the left iff [ki, /ci+i] is an inversion and it is an inversion on the right iff [ki^i + l,ki — 1] is an 
inversion. Finally, for li^i we have the situation that it is an inversion on the left iff it is an inversion on the 
right or the condition Z^+i G [fci+i, fci+2] H [/c^ — 1, ki^2] can not be met. 

The case j = 4 is similar though a bit more complicated and left to the interested reader. 
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